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5— i , Abstract 

A strong direct product theorem states that if we want to compute k independent instances of 
a function, using less than k times the resources needed for one instance, then the overall success 
probability will be exponentially small in k. We establish such a theorem for the randomized 
communication complexity of the Disjointness problem, i.e., with communication const ■ kn the 
success probability of solving k instances of size n can only be exponentially small in k. This 
solves an open problem of |KSW07i ILSS08J . We also show that this bound even holds for 
^ ■ AM-communication protocols with limited ambiguity. 

\ The main result implies a new lower bound for Disjointness in a restricted 3-player NOF 

protocol, and optimal communication-space tradeoffs for Boolean matrix product. 

Our main result follows from a solution to the dual of a linear programming problem, whose 
feasibility comes from a so-called Intersection Sampling Lemma that generalizes a result by 
O ! Razborov |Raz92j . 

1 Introduction 

oo 
o 

On 
O 



1.1 Direct product theorems 



One of the fundamental questions that can be asked in any model of computation is how well 
computing several instances of the same problem can be composed. Are significant savings possible 
when computing the same function / on k independent inputs? Or is it true that the optimal way 
to do this is to run the same algorithm independently k times? 

This question can be asked for any measure of complexity and is usually referred to as the direct 
sum problem. In this paper we consider the model of randomized communication complexity. A 
protocol between players Alice and Bob is given k inputs (xi,yi), . . . , (xk,yk), and has to output 
the vector of k answers f(xi,yi),...,f(xf.,yk)- The question is how the protocol can optimally 
distribute its resources among the k input instances it needs to compute. In this setting we are not 
only concerned with the overall communication, but also with the achievable success probability. If 
the trivial way of computing / for k input instances by running the same protocol k times indepen- 
dently is really optimal, then we should expect the success probability a to go down exponentially 
with k. 

Such statements can come in two flavors. First, if every protocol with communication c has 
constant error probability when computing just one instance of /, then for computing k instances 
with communication c we expect a to be exponentially small in k. If this is the case for a function 
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/, we say that a weak direct product theorem holds for /. If this is the case for all functions, we 
say that a weak direct product theorem holds in general. 

However, even if we allow our protocol to use communication kc we might expect a to be 
exponentially small in k, unless the protocol could somehow correlate its computation on several 
instances for all possible choices of inputs. If such a statement is true we call it a strong direct 
product theorem (SDPT). 

Strong direct product theorems are usually hard to prove and sometimes not even true. In 
particular Shaltiel [ShaOlj exhibits a general setup in which strong direct product theorems cannot 
be expected, and in fact even direct sum theorems (in which we do not care about the success 
probability but only about the scaling of the complexity with k) do not hold. His main argument 
is that in the distributional complexity setting one can construct functions / for which there is a 
"hard core" of some size e that cannot be ignored when allowing only error probability e/3 (making 
computing one instance hard), yet given k instances only roughly ek of them will be in the hard core, 
and we can re-allocate most of our resources to those. By construction / is trivial outside the hard 
core and we can easily solve the other instances. Altogether this approach uses roughly ek times 
the resources needed for one instance while having very small overall error. The main conclusion of 
this example should be that when proving direct sum type statements in the distributional setting 
one should expect to lose a factor of e in the complexity bound. 

An incomplete list of examples of "positive" results about DPT's are Nisan et al.'s (NRS94J 
strong direct product theorem for "decision forests", Parnafes et al.'s [PRW97] direct product the- 
orem for "forests" of communication protocols, Shaltiel's strong direct product theorems for "fair" 
decision trees and for the discrepancy bound for communication complexity under the uniform 
distribution [ShaOl], Lee et al.'s analogous result for arbitrary distributions [LSS08J, Viola and 
Wigderson's extension to the multiparty case |VW08j . Ambainis et al.'s SDPT for the quantum 
query complexity of symmetric functions [ASW09] . Jain et al.'s SDPT for subdistribution bounds 
in communication complexity [JKN08], Ben-Aroya et al.'s SDPT for the quantum one-way commu- 
nication complexity of the Index function [BRW08], Impagliazzo et al.'s DPT for uniform circuits 
[IJKW08J and several more. In a similar vein are "XOR"-lemmas like Yao's [Yao82| . "Direct 
Sum" results which state that k times the resources are needed without the success probability 
deterioration are also important in communication complexity, see [KN97, BBCR10J. 

In this paper we focus on the Disjointness problem in communication complexity. Suppose Alice 
has an n-bit input x and Bob has an n-bit input y. These x and y represent sets, and DISJ n (:r, y) = 1 
iff those sets are disjoint. Note that DISJ n is the negation of NDISJ n = OR n (x A y), where x A y is 
the n-bit string obtained by bitwise AND-ing x and y. In many ways, NDISJ n plays a central role 
in communication complexity. In particular, it is "NP complete" [BFS86] in the communication 
complexity world. The communication complexity of NDISJ n has been well studied: e.g. it takes 
0(n) bits of communication classically [KS92, Raz92j and Q(y/n) quantumly [AA03, Raz03j. 

For the case where Alice and Bob want to compute k instances of Disjointness, we establish a 
strong direct product theorem in Section O 

SDPT for randomized communication complexity: 

(k) 

Every randomized protocol that computes NDISJn using T < f3kn bits of communi- 
cation has worst-case success probability a = 2~™ k \ 

Note that the same result holds for DISJ n by symmetry. Previously, Klauck et al. |KSW07| proved 
that the same success probability bound holds when the communication is f3ky/n (but even in 
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the quantum case). The same bound was obtained by Beame et al. [BPSW06J for randomized 
communication, and they give an SDPT for the rectangle bound under product distributions (under 
such distributions DISJ n has complexity \/n). The rectangle bound appears in the literature also 
under the name corruption bound |Yao83t IK03} IBPSW06] . Klauck [K04| also showed a weak DPT 
for the rectangle bound under all distributions, which implies that with communication /3n the 
success probability goes down exponentially in k. 

Our approach is as follows. First we massage the problem in a very similar manner as in 
[KSW07^. This leads to the problem of finding k elements in the intersection of two N bit strings. 
Since these can easily be verified, we can assume that the protocol either gives up or produces 
correct outputs. We are interested in the tradeoff between success probability and communication. 

The next step is to formulate a linear program that corresponds to a relaxation of an integer 
program expressing a convex combination of partitions of the communication matrix with the 
desired acceptance probabilities. Similar programs have been considered before by Lovasz [L90J 
and by Karchmer et al. [KKN95], but have rarely been used to bound randomized communication 
complexity. The program expresses that we can detect inputs x, y with intersection size k with 
"high" probability, while not accepting inputs with smaller intersection size at all, and, trivially 
but importantly, accepting the remaining inputs with probability at most 1. This extra constraint 
expresses the fact that we do not talk about covers of the communication matrix, but partitions. 
Unsurprisingly we prove the lower bound by exhibiting a solution to the dual. This approach is 
intimately related to the smooth rectangle bound explored in .IK 10 . see Section 1.3. 

To prove feasibility of the dual solution we provide what we call the intersection sampling 
lemma. This lemma is a generalization of Razborov's main lemma from [Raz92j and follows from it 
by a rather simple induction argument. The intersection sampling lemma states that (for suitable 
distributions) any rectangle that is large among the disjoint x,y is also large for inputs that have 
intersection size k. This is true for every k, losing a 2 k factor. Razborov's Lemma is essentially the 
same statement for k = 1. 



1.2 Applications 

1.2.1 Communication-Space Tradeoffs 

Our main result has some applications to other problems. First, we consider communication-space 
tradeoffs. Research on communication-space tradeoffs has been initiated by Lam et al. [LTT92] in a 
restricted setting, and by Beame et al. [BTY94J in a general model of space-bounded communication 
complexity. In the setting of communication-space tradeoffs, players Alice and Bob are space 
bounded circuits, and we are interested in the communication cost when given particular space 
bounds. 

We study the problems of Boolean matrix-vector product and Boolean matrix product. In the 
first problem there are an N x N matrix A (input to Alice) and a vector b of dimension N (input to 
Bob), and the goal is to compute the vector c = Ab, where Cj = V™ =1 (A[i, j] A bj). In the problem 
of matrix multiplication two input matrices have to be multiplied with the analogous Boolean 
product. 

Time-space tradeoffs for Boolean matrix-vector multiplication have been analyzed in an average 
case scenario by Abrahamson [Abr90] , whose results give a worst case lower bound of TS = n(N 3 / 2 ) 
for classical algorithms. He conjectured that a worst case lower bound of TS = fl(N 2 ) holds, which 
was later confirmed in |KSW07| . 
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Beame et al. [ BTY 94] gave tight lower bounds for communication-space tradeoffs for the matrix- 
vector product and matrix product over finite fields, but stated the complexity of Boolean matrix- 
vector multiplication as an open problem. Klauck |K04| generalized the results for finite fields to the 
quantum case, but also showed the following lower bounds for the Boolean product and randomized 
protocols: for matrix- vector product CS 2 = f2(iV 2 ), and for matrix-matrix product CS 2 = f2(iV 3 ). 
Using our direct product result we are now able to show that any randomized protocol for matrix- 
vector product satisfies CS = f2(iV 2 ), and for matrix-matrix product CS = f2(iV 3 ). These bounds 
match the trivial upper bounds. 

1.2.2 Multiparty Communication 

Consider the Nondisjointness problem in the 3 player number-on-the- forehead setting, i.e., Alice 
sees inputs y, z Bob sees x, z and Charlie sees x, y. They have to decide whether there is an index 
i such that Xi = yi = Zi = 1. Lee and Shraibman [LS09] as well as Chattopadhyay and Ada 
[CA08| show that the randomized complexity of this problem is fi(n 1//4 ). Prior to these results 
larger bounds were shown for models in which the interaction between the players is restricted. In 
particular, in the model with one-way communication, Viola and Wigderson show a Q(y/n) lower 
bound [VW07], and in the model, where Charlie sends a single message, followed by an arbitrary 
protocol between Alice and Bob, Beame et al. [BPSW06] show an ^(n 1 / 3 ) lower bound, which was 
later simplified by Ben-Aroya et al. [BRW08]. Using our main theorem we can show that the latter 
type of protocol actually needs communication Cl(y/n). 

1.3 The Smooth Rectangle Bound 

Our main result is proved by giving a solution to the dual of a linear program. While this program 
is tailor made for the problem at hand, this is a general approach described e.g. in [L90[ [KKN95] , 

In |L90| Lovasz in describes such a LP-based lower bound method for randomized protocols, 
which can be seen to be equivalent to the rectangle bound (for a proof see [JK10]). Adding a 
seemingly trivial constraint to the LP described by Lovasz in gives a more powerful lower bound 
method (via the dual), by using the fact that protocols partition the inputs into rectangles instead 
of covering them. The lower bound method is similar to the rectangle bound, but allows the use 
of negative weights for a small fraction of the 1-inputs. We refer to this enhanced LP-based lower 
bound method as the smooth rectangle bound, because it can be seen as a maximum of the rectangle 
bounds achievable by functions that are close to the function / we are interested in. The smooth 
rectangle bound is defined and explored in I.IK 10 . The linear program that we use to establish our 
main result also uses the partition property crucially, and in fact, Lemma 1 could not be established 
using the rectangle bound. 

The smooth rectangle bound relates to the rectangle bound similar to the way the generalized 
discrepancy method (introduced by |S08t K07J and named so in [CA08J) relates to the standard dis- 
crepancy bound (both methods are lower bounds on quantum communication, and the generalized 
discrepancy is in fact equivalent to Linial and Shraibman's (approximate) 72-measure [LiS09j). 

We can pinpoint the power of the smooth rectangle bound (for Boolean functions) more closely 
by observing that it actually lower bounds unambiguous AM-protocols. Indeed our main result also 
holds for AM-protocols with ambiguity 2 ek as we state in Theorem 11. Note that NDISJ n has 
very efficient nondeterministic protocols (and so does its /c-fold), so the lower bound really comes 
from the partition constraints. In particular we also show that any unambiguous AM-protocol 
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for NDISJ n needs linear communication (while nondeterministic protocols need communication 
O(logra)). Note that proving lower bounds for unrestricted AM-protocols is an open problem. 

2 Preliminaries 

In this section we give some definitions of some of the models of communication we study. We refer 
to [KN97J for more background in communication complexity. 

2.1 Some Definitions on Communication Complexity 

The protocols we consider are in the standard two-player model [Yao79t IKN97| unless stated oth- 
erwise. The randomized protocols we consider are public coin protocols. Success probability of a 
protocol is defined to be the probability over the coins to compute the correct output for a worst 
case input. Note that we require both players to agree on a common output. 

A nondeterministic protocol for a Boolean function / is a cover of the 1-inputs in the communi- 
cation matrix of / with 1-chromatic rectangles, its cost is the logarithm of the number of rectangles 
used. Alternatively, a nondeterministic protocol can be viewed as a proof system, in which a prover 
sends a proof to Alice, after which Alice and Bob verify the proof. In a valid protocol for all 1-inputs 
there exists a proof that is accepted, and for all 0-inputs all proofs are rejected. The cost is the 
amount of communication between Alice and Bob. A nondeterministic protocol with ambiguity t 
is a nondeterministic protocol in which each 1-input has no more than t different proofs. For t = 1 
such protocols are called unambiguous. 

Karchmer et al. [KNSW94] have shown that nondeterministic protocols with ambiguity t have 
complexity at least 0(y / 'D(f) /t). Also the rank lower bound holds for unambiguous protocols. 

In a computation of a A>tuple of Boolean functions by a nondeterministic protocol, the prover 
wants to convince Alice and Bob of the fact that f(xi,yi) = 1 for as many i as possible. Such a 
protocol is correct, if for all x\, y%, . . . , Xk,yk such that f(xi, Xi) = 1 for all i G I C {1, . . . , k} there 
is a proof such that Alice and Bob agree on output oi, . . . , o& with Oj = 1 <^=^ i 6 I, while for no 
i / there exists a proof such that Oj = 1 will be an output. Note that in this definition we never 
require the prover to convince Alice and Bob of the fact that f(xi,yi) = for any position i, so 
this is genuine one-sided nondeterminism for many-output problems. 

In other words every nondeterministic protocol with ambiguity t is a collection of at most 2 C 
rectangles each labeled by an output sequence such that for each input x\,yi, . . . , Xk,yk and each 
rectangle R with output oi, . . . , o% containing that input: Oj < f(xi,yi) for all i, and there exists a 
rectangle containing the input where o« = f(xi,yi) for all i. Furthermore each input is contained 
in at most t such rectangles. The communication cost is then c. 

An Arthur-Merlin communication protocol (first suggested in [BFS86] ) with ambiguity t and 
communication c is a convex combination of a set of nondeterministic protocols Pi, each occurring 
with probability pi. Each nondeterministic protocol is a collection of at most 2 C rectangles each 
labeled by an output sequence and each input is contained in at most t such rectangles per Pi. 
We require that for each input xi, yi, . . . ,Xk, y^ with probability at least 1 — e the protocol Pi 
has x±,yi, . . . ,Xk,yk in some rectangle labeled f(x\, y\), . . . , f(xk,yk), whereas with probability at 
most e a Pi contains the input in a rectangle labeled with Oj = 1 while f(xj,yj) = for some i. An 
AM-protocol with ambiguity 1 is called unambiguous (note that for different values of the public 
coin different proofs are allowed for the same input). 
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2.2 Communicating Circuits 

In the standard model of communication complexity Alice and Bob are computationally unbounded 
entities, but we are also interested in what happens if they have bounded memory, i.e., they work 
with a bounded amount of storage. To this end we model Alice and Bob as communicating circuits. 
In short, these circuits place no restrictions on local gates, but require the number of bits stored 
locally to be bounded. Communication is the number of wires crossing between Alice and Bob's 
part of the circuit. 

A pair of communicating circuits is actually a single circuit partitioned into two parts. The 
allowed operations are local computations and access to the inputs. Alice's part of the circuit may 
read single bits from her input, and Bob's part of the circuit may do so for his input. Otherwise 
arbitrary gates (of any fan-in) on the locally available bits can be used. 

The communication C between the two parties is simply the number of wires carrying bits that 
cross between the two parts of the circuit. A pair of communicating circuits uses space S, if the 
whole circuit works on S bits storage. In the problems we consider, the number of outputs is much 
larger than the memory of the players. Therefore we use the following output convention. The 
player who computes the value of an output sends this value to the other player at a predetermined 
point in the protocol, who is then allowed to "forget" the output. Outputs have to be made in 
some specified order in the circuit, i.e., we expect the ith. output to be made at a specific gate. 

3 The Direct Product Theorem 

In this section we formally state and prove our main result. 
3.1 Massaging the Problem 

In this section we bring the A;-fold NDISJ n problem into anther form that will be easier to handle. 
More precisely, we will consider the following three problems. We freely identify strings x £ {0, l} n 
with the sets they are characteristic vectors of. 

(k) 

Definition 1 1. NDISJn is the problem, given k pairs of strings Xi,yi of length n each, to 
compute the k-tuple of function values o/NDISJ n on these. 

(k) 

2. SEARCH^ is the problem, given k pairs of strings Xi , j/j of length n each, to find indices 
ji , . . . , jk , such that Xi and yi intersect in ji . If X{ and yi are disjoint, output for position i . 

3. SEARCH^ is the problem, given two strings x,y of length N, to find k indices j\, . . . 
such that x and y intersect in all ji. If \x n y\ < k output 0. 

We will prove that problem 3) is hard in the following subsections and state the result now. 

Lemma 1 (Main) There are constants < a, /3, 7 < 1 such that every randomized protocol with 
communication j3N for the problem SEARCH^ with k < *yN has success probability at most 2~ ak . 

We now establish that the first two problems are also at least as hard as 3) by reductions very 
similar to the analogous reductions in [K SW07] . 
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Theorem 2 (SDPT for Search) There are constants < a',/3 < 1 such that every randomized 

(k) <h 

protocol with communication (3kn for the problem SEARCH^ has success probability at most 2~ a . 

Proof. We show that a protocol for SEARCH^ can be used to solve SEARCH^ for K = ak/A 

and N = kn. Fix a protocol P for SEARCH^ with success probability a. Now consider the 
following protocol that acts on A-bit inputs x, y: 

1. Apply a uniformly random permutation ir to x and to y. 

2. Run P on tt(x), ir(y). 

3. If P makes at least ak/A outputs / 0, then output any ak/A of them (after undoing ir). 

4. Otherwise output 0. 

This protocol P' uses the same communication as P. Note that P' will work correctly and solve 
SEARCH/ jv \, whenever P makes no errors and at least ak/A positions i with x\ = yi = 1 end up 

\ak/A) 

in different blocks after applying the permutation ir (so that they can be produced as outputs by 
P), assuming that ak/A such positions exist. 

The probability of at least ak/A positions i with Xj = yi = 1 being in different blocks (assuming 
that so many exist) is at least 

N N-n N-a(k/A)n + l k/4 
N N-l N-a(k/A) + l ~ { 1 ' 

So the success probability of P 1 is at least a ■ (1 — a/A) ak / 4 which defines a' via 

2~aK = 2-"-O fc / 4 ) > 2~ a ' k ■ (1 — a/A) ak / 4 . 

This allows us to choose a constant a' > 0, since (1 - a/4) Q / 4 > 2~° 2 / 8 for < a < 1. 

The above argument only works, if ak/A < jN <^=^ n > a/(A'y). Since the right hand side 
involves only constants the opposite case can be covered by assuming n = O(l), i.e., we now have 
to show that solving many size 0(1) instances is hard. But when the communication is less than 
ek = Q(kn), it can easily be shown via an information theoretic argument, that it is impossible 
to solve SEARCH^ with better success than 2 under the uniform distribution the players 

don't communicate enough to agree on a set of k outputs of sufficient entropy. □ 



Theorem 3 (SDPT for NDISJ n ) There are constants < a" , (3" < 1 such that every randomized 
protocol for NDISJ^ with (3"kn communication has success probability a < 2~ a " h . 

Proof. A protocol P for NDISJ^ with success probability a and communication C < f3"kn can 
be used to build a protocol P' for SEARCH^ with slightly worse success probability: 

1. Run P on the original inputs and remember which blocks are accepted. 

2. Run simultaneously (at most k) binary searches on the accepted blocks for a limited number 
of steps that halve the search space. Stop after s = 21og(l//3") such steps. Each iteration 
is computed by running P on the parts of the blocks that are known to contain a position j 
with Xi(j) = yi(j) = 1, halving the remaining instance size each time. 



7 



3. Run the trivial protocol on each of the remaining parts of the instances to look for an inter- 
section there (each remaining part has size n/2 s ). 

This new protocol P' uses communication (s + l)C + kn/2 s = 0(/3" log(l//3")/cn). With probability 
at least a s+1 , P succeeds in all iterations, in which case P' solves SEARCH^. 

So setting j3" such that /3 > 0(/3" log(l//3")) and a" = a' /(s + 1) we get the desired reduction. 

□ 



3.2 Our Approach 

In order to establish Lemma 1 we need to use a new approach to prove lower bounds in communica- 
tion complexity. To see this we discuss the main techniques available. The rectangle bound cannot 
be used to prove Lemma 1, because there exist large monochromatic rectangles for all possible 
outputs except rejection, since the problem has low nondeterministic complexity: simply guess k 
outputs and check. While large rectangles for the inputs that must be rejected need to have at least 
constant error due to Razborov's lower bound for the distributional complexity of DISJ n [R az92] . 
simply considering those inputs cannot establish the error bound we seek. So the rectangle bounds 
appears to be unsuitable for our purpose. Note, however, that it might be possible to establish the 
strong direct product theorem for DISJ n using the rectangle bound, but our approach via Lemma 
1 cannot go this way. 

Another main method for proving lower bounds for randomized communication complexity is 
the 72 /generalized discrepancy method due to Linial and Shraibman/Sherstov [LiS09j IS08] (and 
inspired by earlier work in [K07| ). However, since these lower bounds work in the quantum setting, 
they cannot improve upon the tight quantum bounds in [KSW07]. 

Finally one could employ information theoretic techniques like in [BKKS04J. However, proving 
direct product statements with such methods seems to be difficult. 

We show our main result using a technique based on linear programming. In the dual picture we 
still have to argue that all rectangles have certain properties, however, this time we allow positive 
and negative weights instead of a single hard distribution. This expresses the extra constraints 
given to us by the fact that a protocol partitions the communication matrix into rectangles instead 
of just covering it. 

In the next subsections we first describe our linear program, then define a costly solution to the 
dual, and finally prove that this solution is feasible. 

3.3 The Linear Program 

In this section we provide a linear program, whose value gives a lower bound on the communication 
complexity of solving SEARCH^ with success probability a. This will be our tool to establish 
Lemma [TJ 

So consider any protocol for SEARCH ^ with success probability a. We can assume that the 
protocol either rejects, or outputs i±, . . . , i^. In the latter case we require that the inputs x,y do 
actually intersect on those positions, or the other way around, that wrong outputs of this form 
have probability 0. This we can assume, because Alice and Bob can simply check an output, before 
making it "official". The communication overhead is just two bits to agree on the output being 
correct. Furthermore in this case every message sequence has a fixed particular set of outputs that 
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Alice and Bob agree on, i.e., for any rectangle R that corresponds to a leaf of the communication 
tree (for any value of the random coins) there are k different positions i±, . . . , such that all inputs 
x,y G R intersect on them, or the protocol rejects (they need not be unique though). Otherwise 
the protocol would declare a non-rejecting output that is not correct for some inputs (note that by 
definition Alice and Bob must agree on an output in each terminal rectangle in the communication 
tree). 

We can change such a protocol to a protocol with binary output in which inputs with intersection 
size k are accepted with probability > a, whereas all inputs with intersection size smaller than k 
are accepted with probability 0. Furthermore on all inputs acceptance happens with probability 
at most 1. This latter trivial constraint is important in our proof. The linear program is now as 
follows. We have real variables wr for all rectangles R C {0, l} n x {0, 1}™. 

min wr s.t. (1) 

R 

for all x, y with \x n y\ < k : wr = (2) 

R:x,y€R 

for all x, y with \xC\y\ = k : wr > a (3) 

R:x,y&R 

for all x, y with \x fl y\ > k : wr < 1 (4) 

R:x,y&R 

w R >0 (5) 

Let P be a randomized protocol with communication c and success probability a for the problem 
of accepting inputs x, y with \xC\y\ = k while rejecting inputs x, y with \x n y\ < k with certainty 
(acceptance probability on the other inputs does not matter). P can be used to create a solution to 
the above program with cost 2 C : P is a convex combination of deterministic protocols P \ , . . . , P m 
with probabilities pi, ■ ■ ■ ,p m , and each deterministic protocol Pi corresponds to a partition of the 
inputs into 2 C rectangles. We restrict our attention to the rectangles on which protocols Pi accept. 
The weight wr of a rectangle R is the sum of the pi over all Pi in which R occurs as an accepting 
rectangle. Then for all inputs x, y the value J2r x yeR W R 1S si m ply the acceptance probability of 
the protocol P, and the solution is feasible with cost 2 C . Hence for any a the logarithm of the 
optimal cost of the program yields a lower bound on the necessary communication. 

Recall that above we have not only required that the protocol P accepts inputs x, y that intersect 
in exactly k positions with some probability > <r, but we have also that for each accepting message 
sequence (i.e., each accepting rectangle R) there is a set of positions / C {1, . . . ,n}, |/| = k such 
that for all inputs x, y £ R we have / C x n y. Denote by TZ V the set of all rectangles R for which 
there is an / C {1, . . . , n}, |/| = k such that all x,y G R satisfy I Q x Hy. We can hence restrict 
the rectangles R to come from 1Z V in our LP. This also makes the constraints (2) superfluous. 

We now take the dual of the program (with restricted rectangle set 1Z V ) and then show a lower 
bound by exhibiting a feasible solution of high cost. 
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The dual is 



max 



^2 <T<j>x, y + ip: 



s.t. 



(6) 



4>x,y > 
1px,y < 

if \x Pi y\ 7^ k then (p X: y = 

for all R £ 1Z V : (f) XjV + ip X) y < 1 



(7) 
(8) 
(9) 

(10) 



x,y£R 



The program asks us to put weights on the inputs, where inputs x, y with intersection size k 
should receive positive weights, and some other inputs negative weights. The constraints demand 
that all rectangles in 1Z V either have small weight or contain enough negative weight to cancel most 
of the positive weight (we will discuss this approach further in Section 5). However, we can only 
afford an overall amount of negative weight which is much smaller than the overall positive weight 
(by a factor of a), because otherwise the objective function becomes negative. Negative weights 
make it easier to satisfy the rectangle constraints (10), but deteriorate the cost function. Note that 
later on we will prove that all rectangles are either small, or the inequality in (10) can even be 
made negative. This is similar to the standard argument occurring with the usual rectangle bound: 
rectangles are either small, or they have large error. In the LP formulation both possibilities are 
rolled into one statement. 

Intuitively the LP formulation states that it is hard to cover the inputs with intersection size k 
while keeping the partition constraints (4) satisfied. Note that the primal without (4), but keeping 
(2) has a very simple solution of cost exp(/clogn), even for a = 1. The issue with that solution is 
that it corresponds to a nondeterministic protocol, but not to a randomized one. 

3.4 The Solution 

Having found a dual program which will allow us to prove a lower bound, we start by defining 
distributions on inputs with different intersection sizes in a similar way to [Raz92 . 

Definition 2 For I = . . . C {l,...,n} with \I\ = k denote by Si^ n the set of inputs 
x,y G {0, l} n x {0, l} n such that x Pi y = {ii, ... ,it}- Furthermore let T^^ = Ui^i^Sj^ denote 
the set of all inputs with intersection size k. 

A^n.m * s a distribution on {0, l} n x {0, l} n . All x,y have probability 0. Inputs in Th n 
that also satisfy \x\ = \y\ = m are chosen uniformly, i.e., with probability 



1 




An easy calculation shows 



Lemma 4 




10 



f J, k,n+k,m+k(. x i I/) — (n+k\ ' l^0, n , m ( X '2/ )' 



k 



Hk,n,in{%-,y) — / n \ ' f^O,n—k,m—k{ x iV )> 




where x'y' are inputs resulting from x,y, when k intersecting positions are removed. 

The solution to the dual program is based on the following intuition. Since the problem is 
symmetric, we should assign weights uniformly for all inputs x, y with a given intersection size 
(and set size). Naturally we put a good amount of positive weight on the inputs in T kjU , and these 
are the only inputs with positive weights. We do not need to put negative weights on inputs with 
smaller intersection sizes, since we already restricted the set of viable rectangles to 1Z V , hence those 
inputs appear in no rectangle in the program. All we need to do is to find a set of inputs to assign 
negative weights to, in order to enforce the rectangle constraints (the overall negative weight we 
can distribute is a times the overall positive weight, and we hope that the program stays feasible 
with a large objective function for a exponentially small in k). It turns out the 2k- intersection 
inputs work just fine. This is because the 2/c-intersection inputs end up in many more rectangles 
than their weight suggests compared to the fc-intersection inputs. 

So we define a solution as follows (the input length is set to n + k in the remainder of the 
section): 

• The positive weight inputs are in T ktJl+k . Their weight is defined as 4>x,y = 

• The negative weight inputs are in T 2k , n +k- Their weight is ip X) y = -2 l3n 2- ak fi 2 k,n+k,m+k(x, y). 

• For all other inputs x, y : <f> x>y = ip Xjy = 0. 

/3, a > are some constants that we choose later. We can right away compute the value of this 
solution, before checking its feasibility. If we set a = 2~ ak+1 , then the value is 



since both /it's are distributions. So for ak < (/3/2)n we get a linear lower bound on the 
communication, and we will require k < jn/2 for some 7 < (3 and set a = 1/2. Hence, all that 
remains to establish Lemma 1 is showing feasibility of our solution for these parameters. 

The "sign" constraints (7,8,9) are obviously satisfied, so the only thing we need to check are 
the rectangle constraints (10). The following lemma is the main ingredient of the proof. 





X 2f 3n 2- ak m<n+k , m+k (x,y) 
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Lemma 5 (Intersection Sampling Lemma) There is a constant 7 > 0, such that for each 
rectangle R = A x B C {0,1}™ x {0,1}™ with fJ,o,n,m(R) > 2 -7 ™ and all k < 772/2 we have 

Vk,n,m(R)>V0,n,m(R)/ 2k+1 - 

This lemma is a generalization of Razborov's main lemma in |Raz92j . which is essentially the 
same statement for k = 1. We shall give the proof in the next section, however, now it's time to 
show that our solution to the dual program is feasible. 

So let us check the rectangle constraints. If R is a rectangle first suppose that Hk.n+k,m+k(R) < 
2- /3 ". In this case Y, x ,yER<t>x,y ^ J2x, y eRnT k , n+k 2 /3 ™/ifc,„ + fc, m +fc(a;, y) < 1. 

Hence we need only worry about large rectangles R G 7Z V . For each such R there is a set 
I = {ii, . . . , ifc} of size k such that all inputs x,y m R intersect on /. If we remove those positions 
from the universe {1, . . . ,n + k} (I is actually unique for all rectangles that contain inputs with 
positive weights at all) we can consider R as a rectangle R' in {0, 1}™ x {0, 1}™. Clearly /io,n,m(-R') > 

l^k,n+k,m+k 

(R), since all inputs in R n T kjTl+k have a corresponding input in i?' n T 0>n , and for each 
(x,y) = f^k,n+k,m+k ■ fi. )• So the intersection sampling lemma is applicable to i?' as 
long as we set /3 = 7 and k < 771/2. The lemma tells us that Hk,n,m{R') > /-io,n,m(-R')/2 fc+1 - 
Consequently, 



(fc) 

/^2fc,n+fc,m+fc (12) = Mfc^W ■ T^k (11) 

I 2k ) 



(fc) 



> V0,n,m( R ') ■ rn+kp k+1 ( i2 ) 



:){_ 

2^ 



Hk,n+k,m+k{R) ■ k +k , (13) 



> /"fc ,n+fc,m+fc 

(R) ■ n(2 k /Vk), (14) 

where (11) and (13) follow from Lemma 4, (12) from Lemma 5, and (14) using Sterling approxi- 
mation. 

So, surprisingly, the intersection sampling lemma lets us conclude that R contains a lot more 
weight on 2/c-intersections inputs than on fc-intersection inputs. Of course this is really a conse- 
quence of the fact that we forced the original protocol to be correct in its (non-rejecting) outputs, 
and hence the fact that every rectangle we consider has one set of k positions that all its inputs 
intersect in. 

So 

A*fc,n+fc,m+ k(x,y) 

x,yeR x,y£RnT k ^ n+k 

— 2^™/J 2 fc, n +fc,m+fc( 2; ) 2/)2 ak 

,71 

< 0. 

The rectangle constraints are satisfied and our program is indeed feasible. We have the param- 
eters j3 = 7, and a = 2~ ak+1 , and a = 1/2, as well as k < 777/2. Overall our solution to the dual 
proves that no protocol with communication f3n can solve SEARCH^n+fc-j with success better than 

a, as long as k < 777/2. By adjusting constants this proves Lemma 1. 



12 



3.5 The Intersection Sampling Lemma 



In this section we prove Lemma 5 which we have used to establish the feasibility of the solution to 
the linear program exhibited in the previous section. 

The base of the induction proof will be provided by Razborov's main lemma from [Raz92| 
restated as follows: 

Fact 6 There is a constant 5 > 0, such that for all m £ {n/4 — 5n, . . . , n/4} and for every rectangle 
R C {0, 1}™ x {0, 1}" with u ,„, m (i?) > 2~ 5n we have 

l^0,n,m 

(i?)/(3/2). 

The factor 3/2 corresponds to error 2/5 in the original statement, but it can be seen easily, 
that any error 1/2 — e can be achieved in Razborov's proof by reducing the size of the rectangles 
considered suitably (i.e., by lowering the communication bound 5n considered). Also Razborov 
fixes m = n/4, but slightly smaller sets can be accommodated in the proof0 

We prove the following statement by induction. 

Lemma 7 There is a constant 7 > 0, such that for m = n/4 and every rectangle R = A x B C 
{0, l} n x {0, l} n with Ho,n,m{R) > 2 _7n and all k < 7 n/2 we have 

»k,n,m(R) > «0,n, m (i?)/2 fc - k • 2 ~ S( - n ~ k+1 \ 

In fact we choose 7 = 5/3 (and assume k < 7 n/2). Then the above statement implies Lemma 
5 as stated in the previous subsection, 
of Lemma [7] 

Clearly the base of the induction over k is true by Fact 6. So consider any rectangle R, such 
that uo t n,m(R) > 2~' yn and assume k < 7 n/2. 

For all I C {1, . . . ,n} with \I\ = k let's denote by Ri the rectangle that is the intersection of 
R with the rectangle that fixes X{ = yi = 1 for all i £ J. Now R n {T^ n U • • • U T n) „} = [Jj.\j\ = ^Ri. 
Furthermore every input x,y £ n n R lies in exactly k + 1 rectangles Ri, while all inputs 
x, y G Tk t n H lie in exactly one Ri. Hence 

Hk+l,n,m{R) = ^k+l,n,m(Rl)/(k + 1). 

/:|/|=fc 

Again we can reinterpret the Ri as rectangles R'j in the set {0, l} n ~ fc x {0, l} n_fc , because each 
Rj has all its inputs intersecting on the set /, so we only consider what happens on the other 
positions. 

Note that Ho,n-k,m-k(R'i) = (J>k,n,m(Rl)-(£) by Lemma 4, so we can conclude that Mo,n-Jfc,m-JfcC#r) 
is large whenever n k n m (Ri) is. 



lr The proof needs to be adjusted in several ways. First of all, instead of mixing the distributions on intersection 
size 1 and in the proportions 1/4 and 3/4 we need to mix them uniformly. Secondly, the constant 1/3 in the 
definition of a;-bad can be replaced with a constant close to 1, and consequently the numbers in Claims 3 and 4 need 
to be adjusted. A bit more troublesome is allowing m to be slightly smaller than n/4, since this makes Fact 2 false, 
although it remains approximately true, tilting all other estimates by 1 + 5 factors. 
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Let X = {I C {1, . . . , n} : |J| = k A n ,n-k,m-k{R'i) < 2-^- fc )}. Then 



lex lex ^ ' 



(15) 



Now 



Mfe+l,n,m(-R) = X] Hk+l,n,m{Rl) I {k + 1) (16) 
/:|/|=fc 

= ^ Vl,n-k,m-k(R'l) ■ , n K 77~~TT (17) 
J:|/|=fc U+J ' ^ + ij 

> XI Hl,n-k,m-k{R'l) ■ 7 n \ 7T~T\ ( l8 ) 
I:\I\=kMf£Z ^ k + l} ' [ } 

> V „ /rpM (n-fc)/(3/2) 

/:|/|=fcAJjff U+J ' { + j 

> £ M^mW- / A (k % , (20) 

= X fJ-k,n,m{Rl) ■ ^ (21) 

7:|/|=fcA/0Z 

> E • 5 " 2- 5(n ~ fc) (22) 

> E M,n, m (ii/) • - (fc + l)2- 5 (^ fe ) . (23) 

J:|/|=fc 

(17), (20) are via Lemma 4, (19) uses Fact 6, (22) is from (15), and (23) uses the induction 
hypothesis. □ 



4 Applications 

4.1 Communication-Space Tradeoffs for 
Boolean Matrix Products 

In this section we use the strong direct product result for the communication complexity of Dis- 
jointness Theorem [3] to prove tight communication-space tradeoffs. 

Theorem 8 Every bounded-error protocol with communication C in which Alice and Bob have 
bounded space S and that computes the Boolean matrix-vector product, satisfies CS = ri(iV 2 ). 

Theorem 9 Every bounded-error protocol with communication C in which Alice and Bob have 
bounded space S and that computes the Boolean matrix product, satisfies CS = Q(N 3 ). 
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Proof of Theorem [BJ Alice receives a matrix A, and Bob a vector b as inputs. Given a circuit 
that multiplies these using communication C and space 5 and that has success probability 1/2, 
we proceed to slice it. A slice of the circuit is a set of consecutive gates in the circuit containing 
a limited amount of communication. In communicating circuits the communication corresponds 
to wires carrying bits that cross between Alice's and Bob's part of the circuit. Hence we may cut 
the circuit after f3N bits have been communicated and so on. Overall there are C//3N such circuit 
slices. Each starts with an initial state computed by the previous part of the circuit. This state 
on at most 5 bits may be replaced by the uniform distribution on 5 bits. The effect is that the 
success probability decreases to (1/2) • 1/2 S , i.e., the outputs produced by the slice have at least 
this probability of being correct. 

We want to employ the direct product theorem for the communication complexity of NDISJ^/fc 
(for some k) to show that a protocol with the given communication has success probability at most 
exponentially small in the number of outputs it produces, and so a slice can produce at most 0(5) 
outputs. Combining these bounds with the fact that iV outputs have to be produced gives the 
tradeoff: C/0N ■ 0(5) > N. 

To use the direct product theorem we restrict the inputs in the following way: Suppose a 
protocol makes k outputs. We partition the vector b into k blocks of size N/k, and each block 
is assigned to one of the k rows of A for which an output is made. This row is made to contain 
zeroes outside of the positions belonging to its block, and hence we arrive at a problem where 
Nondisjointness has to be computed on k instances of size N/k. With communication f3N, the 
success probability must be exponentially small in k due to Theorem [3l Hence k = 0(5) is an 
upper bound on the number of outputs produced per slice. □ 

Proof of Theorem [9J The proof uses the same slicing approach as in the other tradeoff result. 
Note that we can assume that 5 = o(iV), since otherwise the bound is trivial: the communication 
complexity without space restrictions is £l(N 2 ). Each slice contains communication f3N, and as 
before a direct product result showing that k outputs can be computed only with success probability 
exponentially small in k leads to the conclusion that a slice can only compute 0(5) outputs. 
Therefore (C//3N) ■ 0(5) > N 2 , and we are done. 

Consider a protocol with f3N bits of communication making k of the outputs. Each such output 
is the Boolean product of a row of A and a column of B, and corresponds to a Nondisjointness 
problem. We partition the universe {1, . . . , N} of the Nondisjointness problems to be computed 
into k mutually disjoint subsets U(i,j) of size N/k, each associated to an output which in 

turn corresponds to a row/column pair A[i], B[j] in the input matrices A and B. Assume that 
there are I outputs (i, j\ ),..., {i,je) involving A[i]. Each output is associated to a subset of the 
universe U(i,jt), and we set A[i] to zero on all positions that are not in one of these subsets. Then 
we proceed analogously with the columns of B. 

If the protocol computes on these restricted inputs, it has to solve k instances of Nondisjointness 
of size n = N/k each, since A[i] and B[j] contain a single block of size N/k in which both are not 
set to if and only if is one of the k outputs. Hence Theorem [3] is applicable. □ 

4.2 Multiparty 

Theorem 10 In the model where Charlie sends one message, followed by an arbitrary interaction 
between Alice and Bob, the 3-party Disjointness problem has randomized complexity D,(- l /n). 



15 



Proof. This proof idea is due to [BRW08]. Let P be a protocol for the 3-party NDISJ n problem 
with £y/n communication and error 1/3. 

We partition {1, . . . , n} into y/n blocks of size ^/n. Charlie's input z is restricted to contain l's 
in one particular block, and O's elsewhere. So in effect z chooses one of \fn instances of NDISJ^ 
given to Alice and Bob. Since Charlie's message does not depend on z, Alice and Bob may reuse 
it in y/n runs of P in order to determine, for all ^fn possible z, the value of all of their NDISJ^ 
problems with overall communication en. For each block the error probability is < e. The expected 
number of blocks where the protocol fails is at most le^fn with probability at least 1/2 by the 
Markov inequality. So for every input x, y to Alice and Bob there is a message from Charlie which 
will make them give the wrong answer for at most 2ey/n blocks with probability at least 1/2. 

We may now simply replace Charlie's message by a uniformly random string which will dete- 
riorate the probability of having at least (1 — 2e)- v /n blocks correct to 2~ e ^~ l ■ 1/2. We have found 
a 2 player protocol with communication en and the mentioned success probability to compute 
(1 — 2e)y / n instances of Nondisjointness correctly. In [BRW08| a general argument is given that 
relates the success probability in this situation to the standard situation of an SDPT (in which 
success means all the outputs are correct). For small enough e this contradicts our main result. 
The idea of such "threshold DPT"'s is further investigated in |U09j . □ 



5 The Linear Programming Bound and Limited Ambiguity 

A major tool to prove randomized communication complexity bounds is the rectangle bound (see 
[K03, BPSW06J). The method was originally introduced by Yao [Yao83 , and its most prominent, 
but by no means only use is in Razborov's Disjointness bound [Raz92]. Informally the rectangle 
bound states that all rectangles in the communication matrix are either small or have large error 
(under some hard distribution). 

In [L90] Lovasz describes the following LP to bound randomized communication complexity. 

min wr s.t. (24) 

R 

for x, y with f(x, y) = 1 : wr > 1 — e (25) 

R:x,y&R 

for x,y with f(x,y) = : wr < e (26) 

R:x,y£R 

w R >0 (27) 



He takes the dual. 



max 



(1 - e)4> x>y + ^2 e<fi X! y S.t. (28) 
x,y:f(x,y)=l x,y:f(x,y)=0 

for x, y with f(x, y) = 1 : <j> X) y > (29) 

for x, y with f(x, y) = : cj) x , y < (30) 

for all R : ^ <j> x>y < 1 (31) 

x,y£R 
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Note that here R ranges over all rectangles in the communication matrix. One can now prove 
a lower bound by exhibiting a solution to the dual. Let <fi(x, y) describe such a solution. 

The optimum of this program characterizes by the (one-sided) rectangle bound, as shown in 
[JKlO] . 

Instead of proceeding like Lovasz, who relaxes (31) (and obtains the spectral discrepancy bound, 
which can be exponentially smaller), we note the absence of the "trivial" constraint 

for all x,y with f(x,y) = 1 : wr < 1. (32) 

R:x,y£R 

The primal Lovasz LP augmented with (32) obviously also gives a lower bound on randomized 
communication. This method is the smooth rectangle bound described in [JKlO] . Consider the 
dual of the augmented program. 



max ^2 0-- e )<fe,y + e x >y + ^2 ^ x >y s,t - ( 33 ) 

x,y-f(x,y)=l x,y.f(x,y)=0 x,y:f(x,y)=l 

for all x, y with f(x, y) = 1 : <j> X)y > 0; ip X) y < (34) 
for all x, y with f(x, y) = : (j) x>y < 0, ; ip X) y = (35) 
for all R : (f> x>y + ip x>y < 1 (36) 

x,ydR 

Is the smooth rectangle bound really stronger than the standard one? Let us find out the 
strongest type of communication protocol that we can still lower bound. Consider unambiguous 
AM-protocols, i.e., convex combinations of partitions with bounded error, see Section 2. It is easy to 
see that the LP with constraint (32) lower bounds such protocols. Note that iV(NDISJ n ) = 0(log n), 
and hence also j4M(NDISJ n ) = O(logn). However, we can show that unambiguous AM protocols 
for NDISJjv need linear communication. To prove that the smooth rectangle bound is large for 
NDISJ ra we can restrict the set of rectangles to 1Z V = {R : 3i : x,y £ R ^ i £ x n y}. This is 
possible by the same argument as Theorem 3, using binary search for a limited number of iterations 
followed by a trivial protocol for the resulting small instance of Nondisjointness, to get a protocol 
for the problem of finding an i with X{ = y% = 1. Again we can assume that we do not accept 
without having seen a witness i. We define a solution to the dual as follows: 

• Inputs in Tq^ have weight (p x>y = — oo. 

• Inputs in T^ n have weight <f> Xjy = 2 /3n /i ljnin / 4 (x, y). 

• Inputs in T 2 , n have weight ip x>y = ^ 2 ,n,n/i{x, y) ■ 3/4. 

• All other inputs have weight 0. 

The cost of this solution is 2 /3n ((l - e) - 3/4). The sign constraints are satisfied. Now consider a 
rectangle R E 1Z V . Let R' denote the rectangle in which we ignore its intersection position i. Then 

fl>2,n,m(R) = Ml,n-l,m-lCflO • (n- l)/( ") ( 37 ) 
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> ^n-l, m -i(^)-(n-l)/(1.5r\) (38) 

= /xi,„, m (i?)-(n-l)n/(1.5Q) (39) 
= A*i, n , ro (/2) • 4/3. (40) 

Above we use that is large (otherwise (36) is trivial) and hence //o,n-i(-R') > n ■ Mi,n(-R) > 
n2 -/3« > 2 S(n-i) and em pi y Fact 6 in (38). 

Then 

y)(l-3/4-4/3) =0. 

x,y£R:f(x,y)=l x,y£R:f(x,y)=0 

This shows that any unambiguous AM-protocol for NDISJ n needs communication O(n). It is 
known [KNSW94] that nondeterministic protocols with ambiguity t need communication \J D(f)/t 
for the deterministic complexity D, and the rank lower bound is also known to hold for unambiguous 
nondeterministic protocols. However, these methods do not allow errors, and the first bound cannot 
achieve linear lower bounds at all (the approximate rank cannot give better bounds than y/n either 
since it lower bounds quantum protocols [Raz03j). 

We can also generalize our main result Theorem 3 in a similar fashion: 

Theorem 11 Assume an AM-protocol with ambiguity 2 ek computes k instances of NDISJ n . Then 
the success probability of the protocol (over the random bits) is at most 2^(~ fc ) unless the commu- 
nication is at least j3kn. 

The proof of this statement is practically identical to the proof of Theorem 3. Going through 
the reductions in section 3 we see that they need only a constant repetition of the original protocol, 
and a polynomial increase in the ambiguity. 

When we come to the search problem and the linear programming formulation note that we 
have to replace the right hand side of constraint (4) by < 2 ek . In the dual this increases the gap 
between 0's and ip's in the objective function, but that gap is already exponentially large in k, so 
nothing in the construction really changes. 

Note that this bound is quite tight, since with ambiguity 2°^ we can reduce the communication 
to any fraction of kn, and with ambiguity n k the communication collapses to 0(k log n) even without 
any error. 
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